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FOREWORD 


This  report  arose  from  an  investigation  into  the  noise  properties  of 
optical  correlation  detectors  as  described  originally  by  T.  M.  Chen  and 
A.  Van  der  Ziel.  1  The  techniques  were  developed  in  a  series  of  seminars  on 
Generalized  Random  Processes,  given  in  the  Solid-State  Research  Laboratory, 
ARX,  in  the  Fall  and  Winter  of  1966-1967. 
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ABSTRACT 


The  mathematical  description  of  noise  by  means  of  Generalized  Random 
Processes  is  presented.  The  effects  on  the  noise  distribution  of  linear  filters 
(amplifiers)  is  discussed  and  related  to  conventional  filter  theory.  The  modifi¬ 
cation  of  the  noise  by  a  quadratic  device  is  then  treated,  and  this  formalism  is 
then  applied  to  the  analysis  of  the  noise  performance  of  a  correlation  detector 
and  a  conventional  square -law  detector.  The  conventional  detector  is  shown  to 
have  a  superior  signal-to-noise  ratio. 
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SECTION  I 


INTRODUCTION 


All  instruments  are  ultimately  limited  in  their  sensitivity  by  noise,  and  it 
frequently  is  desirable  to  know  quantitatively  the  effect  of  that  noise.  Further¬ 
more,  one  is  frequently  interested  in  the  probable  outcome  of  a  measurement 
made  on  an  ensemble  of  events,  i.  e.  ,  the  description  of  the  output  of  an  instru¬ 
ment  when  the  input  can  have  a  range  of  forms  with  some  probability  distribu¬ 
tion.  It  is  the  purpose  of  this  report  to  present  a  most  powerful  formalism, 
due  to  I.  M.  Gel'fand  and  N.  Ya.  Vilenkin2,  in  a  form  suitable  for  application  to 
these  problems.  The  basic  concepts  will  be  developed  first,  then  applied  to 
linear  devices.  This  will  provide  a  description  of  both  the  device  and  the  noise 
or  signals  passing  through  it^Then  the  formalism  will  be  applied  to  the  compu¬ 
tation  of  the  noise  output  of  nonlinear  (quadratic)  devices,  such  as  are  commonly- 
used  for  detection  and  power  measurement.  Finally,  the  entire  procedure  will 
be  applied  to  a  specific  problem:  the  comparison  of  a  quadratic  and  a  correla¬ 
tion  detector.  This  will  illustrate  the  technique  and,  incidentally,  demonstrate 
the  superiority  of  the  simpler  quadratic  detector. 


SECTION  II 

THE  GENERALIZED  RANDOM  PROCESS 


Fundamental  to  the  formalism  is  the  notion  of  a  random  variable,  which 
we  define  as  follows:  A  random  variable  £  is  defined  whenever  we  are  given 
a  function  (x),  where 

PrcL 

and  where 

P^U, )  4=.  P|  (xx)  i-f-  4  xi 

L  iwt  Pfr  U)  —  C  L  nu  Pe  ( *  1 

-«»  f 

L m  Pe  l*)-  Pt  («-). 

<1,-0 


Several  random  variables  * . «*or  equivalently  an  n-dimensional  random 

variable  defined  by  the  joint  distribution  function 

Pf  («„  ■  j  |  f.  <  x,  .  A  function  of  a  random 

variable  *-*  f (?)  is  defined  as  follows:  Let  X  be  the  set  of  all  points  such 
that  f(x)  <  y  for  x  €  X.  Then  P  «  (y)  =  P^.  (X)  is  the  distribution  function  for 
Joint  distributions  such  as  Py01»  ^  ^  <  ’A  t  j  are  explained  more  fully 

by  Gel'fand.  1  The  moments  of  a  random  variable  are  the  values 


ein. 


L 


/ 


where  the  last  symbol  is  called  the  expectati on  of  the  argument.  is  called 

the  mean,  and  the  variance  of  £  . 

The  Generalized  Random  Process  is  now  definable  as  a  mapping  <5^  from 
a  certain  function  space  K  udo^the  set  of  random  variables,  and  possessing  the 
following  properties:  Denote  the  image  of  (x)  by  CfcMV)  .  Then 

a.  t  )  -  *  $ T  p  i  W  )  (Linearity) 

b.  L'-m  impiies 

Li*  («{<W, -.,#(<&  <continuitv5- 

I.  e.,  a  Generalized  Random  Process  is  a  continuous  linear  random  functional 
on  the  space  K  of  infinitely  differentiable  functions  Cf  (t)  having  bounded 
supports.  The  motivation  is  the  following:  if  an  apparatus  described  by  a 
function  Cf’(t)  is  used  to  measure  some  random  process  $  ,  the  result  is  a 
random  variable  ,  characterized  by  both  the  process  ^  and  the 

apparatus  function 

The  principal  quantities  of  interest  are  the  mean  7)1  ((f')  and  the 
correlation  functional  ^((£^<4'.)  defined  by 

7Yl(Cf)-  £  l$«r)]  =  jxdP$M 

and 

£[£(*)$<*>}-  J  riPf  (tq) 


The  most  common  example  of  a  generalized  random  process  is  a 
Gaussian  process  defined  by  the  joint  distribution  function 

Pf(I)=  3f'‘  X,®  ... 


where 


Pj  (X)=  j<Ut  At? 

( aw  rA 


Ak  ^  ~ ^  )j 


and  A(f  -  ((A.,)) 

f^*j  *)  -  ^  ^ 

* 


Fy<R«) 


is  a  non-degenerate  positive -definite  matrix, 
.  Some  properties  of  the  distribution 


=  1 


with 

Fk  (z)  are 


b.  Ejf  Tnw)- o 

c.  f  [f  «fv)$<cfj]=.  A'/j 
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Thus,  this  is  a  nean  zero  process,  and  is  defined  uniquely  by  the  mat-i:  A 
which  in  turn  defined  by  the  correlation  function  0(^4*)  So  specifying 

the  correlation  function  completely  specifies  the  process.  From  the  form  of 
one  sees  that  it  must  be  a  continuous  bilinear  positive  definite 
functional  of  its  two  arguments.  The  usual  form  for  such  a  functional  is 


where  ^  Is  a  positive -definite  generalized  function  of  two  variables. 

When  .%lj  £<(£*(<)))  and 

(fcWJduAfl,  are  identically 

distributed,  the  process  (|>  is  called  stationary.  It  can  then  be  seen  that 


S Cpfc>v|/c*)  B(S-t), 


Then  if  8<A)  are  the  Fourier  transforms  of  CP Is) 

t  .  rs  >  \  ...  , 


and 

Bfs-O  respectively,  one  can  write 

BfA) 

where 

so  that  d^(x) 

is  a  non- 

negative  measure.  A  special  case  is  the  Unit  Process,  defined  by 


BfS't)-  or  cjrffA)  =  c/a.  > 

where  §>(x)  is  the  Dirac  delta -function. 


SECTION  UI 

THE  DESCRIPTION  OF  BAND -LIMITED  NOISE 


i.  <uj) 


Unit  Pr««j 


Fi  I  ter 


Filtered  Noise 


^  1 


‘  ■5  ‘  -  -A.--.SIMM.c-  • -K.viif't'til 
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Assume  in  Fig,  1  one  has  a  filter  of  transfer  function 


Ht  (t')=  ^  |  eta  )  e. 


so  that  if  the  input  is  V,  (+)  the  output  is  Vt-tO-  IdW’*  hi/t~t>)vj  (  t'). 
Then  if  the  input  is  white  noise  {  S.  unit  process),  the  output  at  time  t  is  a 
random  variable  $  (H*)  and  the  correlation  functional  is 


B(M 


or 


Jwfs-t  )  J -  -yl-t-r) 


-A(m)  & 


-i! 


{ 9 TT-A(U-  )  l‘ 


Then,  if  the  filter  consists  of  seve'  al  sections,  e.  g.  , 


where 


K fs)z  jrf*  ;  Lu>=  JVwX' 


then 


ATT  (u>) 


lU-’U. 

e  H(u)  - 


=  i‘,u 


so  that  successive  linear  processes  can  readily  be  introduced.  Thus,  for  a 
succession  of  filters,  we  have 

J3teyO=  -L-Jcfuje^  /OTr-^a*- )l*ISirj((uj)l  ....  /cJrZ-AwJ2, 

for  as  many  functions  as  are  included.  A  useful  concept  is  to  define  the 
"spectral  power  density"  of  the  result  of  white-noise  +  filter  by  the  spectral 
function 


X 


e 


(UL- 


)  -  Isir-Hiuj,,}  . 


Then  successive  filtering  is  seen  to  modify  the  spectral  power  density  by 

o  (u)~  }a n-K  iw)f  p  (lv), 

i)  ) 

where  is  the  transfer  function  of  the  (n  +  1) - st  filter.  In  this 

sense,  the  unit  process  is  seen  (from  (1))  to  have 


1  . 


SECTION  IV 

THE  POWER  IN  A  RANDOM  SIGNAL 


The  power  in  a  signal  is  proportional  to  the  mean  square  of  the  signal,  or 

W—  E'J-c:  {+)irc  it)}  -  )= 

or 

\V  -  |  duj 

thus  motivating  the  term  "spectral  power  density"  for  .  The  unit 

process  is  thus  seen  to  have  a  uniform  distribution  of  pfower  over  all  frequency 
ranges,  hence  an  infinite  total  power.  Passage  through  a  filter  then  limits  the 
frequency  range,  giving  a  finite  total  power  at  the  output.  The  idealization  of 
white  noise  to  the  unit  process  introduces  no  error,  so  long  as  the  region  of 
uniform  power  distribution  of  the  white  noise  is  larger  than  the  bandwidth  of  the 
filter. 


SECTION  V 

THE  DISTRIBUTION  OF  THE  SQUARE 
OF  A  GAUSSIAN  RANDOM  SIGNAL 


The  signal  is  a  random  function  Mt  )  ~  ^  ^  with  a  Gau  ssian 

distribution  of  mean  zero  and  with  correlation  function 

F[  £fs)£(t)}r  J-jjLu>e"u(S 
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The  result  of  squaring  is  a  random  function  —  ('f )  which  is  no 

longer  Gaussianly  distributed.  However,  as  we  will  be  interested  only  in  the 
first  and  second  moments  of  >^{t),  it  will  suffice  to  replace  it  with  a  Gaussian 
process  with  the  same  first  two  moments  (GV  257,  corollary).*  Accordingly, 
we  must  compute 

\=  £ E  l  >$*=•  {--jJ-  j *x  €x?  (“i  j 

where 

C  =-  E(t/0“  L«  .  Wt.  tr  be  . 

Then  we  must  compute 


where 


c 


-> 


B^t) 
E(t,s)  B(tjt) 


Let  B  (s,t)=  j>st  . 


In  this  and  subsequent  calculations  we  will  need  an  extension  of  the  calculation 
of  Gel'fand  (GV  250,  Eq.  5),  or 


m 


jdx  fxp  [-1  (Cy,x)j  =■  T*(AC  )- 

(ob  (A*,<)  j-i  (CrfjX)j  r  3a* -Ha^  , 


<L 


•  j 


(2) 


(3) 


References  are  to  page  numbers  in  Gel'fand  and  Vilenkin.  1 
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where  CLx  's  t*ie  -“urn  of  all  the  principal  2x2  minors  of  AC  1 
problem,  (Ax,  x)  =  (xy  +  yx}/ 2,  or 


For  our 


A  -  1  °  AC-A&-  1  bs,.  bc 

z  >  •«- 

t  O  be,  bsT 

<3.  =;  tsr  j  4%  =  -L  (  £>sfi_  bj~  )  • 

Then  from  (5), 

E  {Vj)Hlt)}=  Pfc/O-  <2B  be  ■ 

The  power  density  spectrum  of  this  process  is  then 

^yuj)=:  J  Ju  e  b(u)  — 

f  -iuju.  /*«  -iru  - •  /  i  «_  v 

=  l  duJuche  £  a'n-b.  aloe}  ■= 

(  ^  J 


- 

o^r 


!>«  (§(w ) 


(4) 


The  5(vo)  term  arises  from  th  i  DC  power  of  the  non-zero  mean.  If  we 
considered  instead  the  process  Till')  -  *  we  have  a  zero  mean  process 

with  V 

Ej(vs>-nX*rt)-V>}=  V  =  3  bVs/O, 

and 
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If  the  squaring  is  followed  by  additional  filtering  (e.  g.  ,  integration),  then  the 
final  signal  has  a  mean 


-  |3tr£(ol|^  =  (atrl»o)Hc  > 
and  a  correlation  function 

^  j  doj,  - 

=  £  ^u'e“‘J,£'t)ia.dW'i  A.  J 

1  (5) 


where  f(*»)  is  the  final  filter  function. 


SECTION  VI 

THE  DISTRIBUTION  OF  THE  PRODUCT  OF  TWO 
GAUSSIAN  RANDOM  SIGNALS 

Consider  two  Gaussianly  distributed  random  signals 
and  £  (i  »  -*  is  i,  where  \£,<S)  and  ift./S)  are  in¬ 

dependent  but  identically  distributed  zero -mean  Gaussian  signals  with  correla¬ 
tion  function 


E:  B  (*-*)•=  E  l  &<%>&(*) j, 

and  where  is  a  common  signal,  independent  of  •Si  ^  and  Aft)  and 

with  correlation  function 


We  wish  to  compute  the  first  two  moments  of  the  product  of  £,hland  in 

order  to  define  an  equivalent  Gaussian  process,  as  we  did  in  Section  V.  With 
ys>*  f,U)  K  (s)  we  need  -  E{%,d)  fs)J  ■=  and 


E  -  I>(S ,*). 


To  compute  these,  we  need  the  correlation  functions 
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and 


£{(£< s>-*^if*)X£^>4  4  <*))}=  Ef  &(*,*)■+  BVmt). 


Thus, 

if  we  let 

(*».*»  A*  * 

*M> 

be  the  observed  values  of 

(?,«x  r.u). 

(*>) 

the  relevant  correlation  matrix  iB 

B  - 

bb-t  tc, 

bst  4  bjr 

f. 

=  c*. 

bit4  k*  br  4  lv 

tsr 

be’ 

bit 

bi>  h  be 

b*s«  4 

.  bit. 

be 

bjr  f  bs  t 

b'c>  k  „ 

To  compute  the  mean  1ft-  £  {>^S>}  -  E  S  > 

use  Eq.  (2),  where  ^  i  J 


O 

O 

f 

o 


o 

o 


I  o 

G  O 


C  G  C 

O  O  O 


>t  -  Ta  AC  *  =  b, 


To  compute  the  correlation  function,  we  have 

t)(s,0=  = 


=  JKI,  j  «/«.</<  xiU±Jt^  UttUAi**}  tf>xp  ' 


we 
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r 


By  making  the  orthogonal  transformation 

r 


x  =  t J  =  _L 

—  —  fl 


» 

o 


o 

I 

o 


l  O 

o  \ 
-I  c 
o  - 1 


*2  > 


we  have 


(cx><>)=:  * « c  -  y*y*c*y*y-  9 * ( w * n * y ) *  /  , 

where 


3b<  -4  bo  3bL-t  b 


**■*  os*- 


J  b*  ■*  Ak*  -*  b« 

o 


be 

bse 


bse 

bo 


Thus,  the  components  (v, ,  y?)  are  independent  of  the  components  (y,,  y .). 
Furthermore,  14  J  4 

*t **  =  (y,1  -  y*1)  (y»*  -y,v)/^  • 

We  obviously  have 

eM=  Eb‘‘h  ak’+t.  j  F|v,‘3-  b„; 

and  for  E £  ■/$'  y,1  ^  ^  we  use  (3),  where 


o 

o 


c 


s 

I 
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Fbo'Y-'h  3k,«-4C(kt  -W)A]  =  3U\  t  b*  , 

and  similarly, 

fly,'  v*1  i  -  a  &'*<  *i*t  f  f  (a bo  +  ^  / 

From  these,  we  get 

TXs,*)^  k\t-t  2feirJ>itr3k j'tl  +  4^*  . 

The  power  density  spectrum  of  this  process  is  then,  like  in  (4), 

63,uj >m  i  >*  •  }^|  "4  ?tTfa^7 

Further,  after  subtracting  the  mean  ,  we  have 

fc>s<- 4-  Obst  i»s-f  +  5bstiJ 

and  after  final  filtering, 

SECTION  vn 

A  COMPARISON  OF  QUADRATIC  AND 
CORRELATION  DETECTORS 


The  block  diagrams  of  the  two  assumed  experimental  arrangements  are 
given  in  Fig.  2.  J.r  the  actual  measurement,  what  is  ordinarily  recorded  is  the 
actual  signal  at  the  output  of  the  integrator.  So  the  quantities  of  interest  are 
the  mean  of  the  (signal  +  noise)  output  and  its  variation,  as  compared  to  the 
noise-only  output.  It  is  presumed  that  the  equipment  is  sufficiently  stable  so 
that  a  good  determination  of  the  noise -only  means  can  be  made.  These  means 
can  be  subtracted  from  the  output,  e.  g.  ,  by  offsetting  the  recorder  pen.  Then 
both  outputs  have  mean  zero  in  the  absence  of  signal,  and  have  rms  deviations 
for  the  correlation  detector  (CD)  and  Gqh  for  the  quadratic  detector 
(QD)  as  given  by  (6)  and  (5)  with  -  C, 

4c*  -  D#(t,s)-  JL  j  |3n  ■&»*))*  j  | 


1 1 


r 


"Df  (s.O - 


_L 


CM 


Signal  -\r - IairdI trier  f- 


N^~-f~Ampllf  ler  ]- 
MNolsel 


€(a3)  +  6^A/i 

_ -  ,-f.ft*?,) - ,  Hecarder  - 

{WuItlpIlerHInte%r*atcr  j — J__j j 

)A. 


CD 


Correlation  Detector  (CD) 


Signal 

*»(«) 


h(*>)  _ fi^) _ . 

~t  Amplifier! - (Squaring! — 1 1ntegrator  |— 

HNolsel 


Recorder 


Quadratic  Detector  (QD) 


fig.  2. 


Thus  the  noise -only  variation  in  the  QD  is  twice  the  variation  in  the  CD.  How- 
Ler.'  .he  signal  inpi.  power  is  split  between  the  two  chaene  ^hs  CD.^  ^ 
that  with  the  signal  on,  we  must  compare  the  results  ol  a  C‘  '  v 

each  channel  t/.he  CD,  while  we  have  a  , ,  (-1  »pu.  to  the  QD. 

The  desired  knowledge  of  the  input  signal  is  its  mean  power,  as  evidenced 
by  the  shift  in  the  mean  of  the  output  of  the  ^tectorswhen  the  stgnal  rson^ 
Thus,  when  we  substitute  (u>)  fo  '  '  ' 


and  a  variation  for  the  ^(s)  about  its  new  mean  of 


1 2 


we  get 


For  the  CD,  when  the  input  signal  to  each  channel  is  ^ 


and  (6)  gives  a  variation  about  the  new  mean  of 


In  both  of  the  arrangements,  the  amplifier  noise  is  regarded  as  white 
noise  limited  by  the  amplifier  response,  so  pi oj>  =  The  signal  was 

assumed  to  lie  entirely  within  the  amplifier  bandwidth,  or  alternatively  (?'<<*-) 
can  be  considered  as  the  signal  power  density  spectrum  multiplied  by 

the  square  of  the  amplifier  transfer  function,  ^ 


The  signal  to  noise  ratio  of  the  quadratic  detector, 


«V> 


prt  t  ^  IS  f*») 

and  the  similar  expression  for  the  correlation  detector 


RC  = 


Ah 


«S**J 


can  be  related  in  the  critical  case  where  filiAj)  »  ^Vuc) 


since  there 


R*  =  /_!* L_\  /(JtL)  =  fa 
Rc  // 


I.e.,  the  signal-to-noise  ratio  of  the  quadratic  detector  is  {  2  times  as 
large  as  the  signal-to-noise  ratio  of  the  correlation  detector. 

These  values  can  be  easily  obtained  explicitly  in  the  case  where 
5Cvo- io0  )  j  and  the  final  filter  is  an  integrator 

ft.T 

x-c(t)~  _L  eft'  vnt) 

rv»r*  I  *  * 


ST 


>t-T 


13 


with  transfer  function  |p*#uu)l=  s;*wr)/(cu'p)  .  This  is  the  case 

of  a  monochromatic  signal  of  unknown  amplitude  incident  on  a  noisy  receiver. 
Then 


- 

CL  •-= 

sip  fatws*  ■= 

-  C 

+  3*£fuO  -e 

a** 

-  < 

+  *  f  (^)  + 

** 

2. 

Thus,  as  T" -9  *“=»  >  the  dispersion  is  due  to  the  dispersion  in  the  quantities 
being  measured.  For  large  T,  furthermore,  the  ratio  of  output  to  dispersion 
becomes  the  same  for  both  devices,  while  for  finite  T  and  small  signals  it 
favors  the  quadratic  detector. 


SECTION  VIII 
SUMMARY 


A  procedure  has  beer  presented  for  analyzing  the  effect  of  any  linear  or 
nonlinear  device  upon  a  Gaussianly  distributed  random  signal.  The  signal  was 
seen  to  be  representable  in  terms  of  its  spectral  power  density  ^fu j)j  the 

power  per  unit  frequency  interval.  The  effect  of  any  linear  device  was  rigorously 
shown  to  be  the  multiplication  of  the  spectral  power  density  by 

where  ’/(u)  was  the  Fourier  transform  of  the  filter's  transfer  function. 
Furthermore,  the  power  density  in  the  output  of  any  non-linear  device  was  de¬ 
rived  in  terms  of  the  correlation  functional 

I>(5,t)=  B  {  VS)>I 
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where  y[(s)  =  F(^>)  describes  the  non-linear  transfer  function. 

This  correlation  functional,  in  turn,  could  be  used  to  define  a  Gaussian  Generalized 
Random  process  for  calculations  involving  subsequent  filtering,  so  long  as  only 
the  mean  and  second  moment  (power)  were  of  interest.  As  an  example,  the 
method  was  used  to  analyze  the  signal-to-noise  properties  of  a  quadratic  and  a 
correlation  detector,  and  somewhat  surprisingly,  demonstrated  the  superiority 
of  the  quadratic  detector.  The  process  is  clearly  capable  of  extension  to  other 
more  complicated  devices. 
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